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1.4.5 Solved Problems: 

Conditional Probability 

In die and coin problems, unless stated otherwise, it is assumed coins and dice are fair and repeated trials are independent. 


Problem 1 

You purchase a certain product. The manual states that the lifetime T of the product, defined as the amount of time (in years) the product 
works properly until it breaks down, satisfies 

P(T > t) = , for all t > 0. 

_ 2 

For example, the probability that the product lasts more than (or equal to) 2 years is P(T > 2) = e 5 = 0.6703.1 purchase the product 
and use it for two years without any problems. What is the probability that it breaks down in the third year? 

• Solution 

o Let A be the event that a purchased product breaks down in the third year. Also, let B be the event that a purchased product does 
not break down in the first two years. We are interested in P(A \ B) . We have 


P{B) = P(T > 2) 

_ 2 

= e 5 . 


We also have 

P(A) = P(2 < T < 3) 

= P(T > 2) - P(T > 3) 

_2_ _ 3_ 

— e 5 — e 5 . 


Finally, since A C B, 


we have A D B = A. Therefore, 


P(A\B) = 


P(AnB) 
P(B) 
P(A) 

P(B) 

2 _ 3 _ 

e 5 —e 5 
~2 
e 5 


= 0.1813 


Problem 2 

You toss a fair coin three times: 

a. What is the probability of three heads, HHHl 

b. What is the probability that you observe exactly one heads? 

c. Given that you have observed at least one heads, what is the probability that you observe at least two heads? 
• Solution 

o We assume that the coin tosses are independent. 

a. P(HHH) = P(H) ■ P(H) ■ P(H) = 0.5 3 = 

b. To find the probability of exactly one heads, we can write 

P(One heads) = P(HTT U THT U TTH) 

= P(HTT) + P(THT) + P(TTH) 
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c. Given that you have observed at least one heads, what is the probability that you observe at least two heads? Let A\ be the 
event that you observe at least one heads, and A 2 be the event that you observe at least two heads. Then 


Thus, we can write 


Ai =S-{TTT}, and P{A X ) = 

O 

A 2 = {HHT, HTH, THH, HHH}, and P(A 2 ) = 

8 


P(A 2 \A 1 ) = 


P{A 2 nA 1 ) 

P(Ai) 

P(A 2 ) 

P(Ai) 

4 8 _ 4 

8 ' 7 7 ' 


Problem 3 

For three events A, B, and C, we know that 

• A and C are independent, 

• B and C are independent, 

• A and B are disjoint, 

. P(A U C) - f,P(BuC7) = 1,P(AUBUC) = § 

Find P(A),P{B), and P{C). 

• Solution 

o We can use the Venn diagram in Figure 1.26 to better visualize the events in this problem. We assume jP( A) = a, P{B) = b , 
and _P((7) = C. Note that the assumptions about independence and disjointness of sets are already included in the figure. 

s 



P{A) = a , P(B) = b, P{C) = c 

Fig. 1.26 - Venn diagram for Problem 3. 

Now we can write 
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P(A U C) = a + c — ac = 
P(BU C) =b + c-bc = 


2 

3’ 

3 

4 ’ 


P(^4 U J3 U C) = a + 6 + c — ac — 6c= —. 

By subtracting the third equation from the sum of the first and second equations, we immediately obtain C = ~ , which then gives 
a = and b = . 


Problem 4 

Let Cl, C 2 > * * * > Cm be a partition of the sample space S, and A and B be two events. Suppose we know that 

• A and B are conditionally independent given Ci , for all i E {1, 2, • • •, M}; 

• B is independent of all Ci 's. 

Prove that A and B are independent. 

• Solution 

o Since the Ci 's form a partition of the sample space, we can apply the law of total probability for A D B: 


P(AC\B) 


E*=i P(AnB\Ci)P(Ci) 

E^p(^ia)p(sia)p(a) 

Et 1 P(A\C i )P(B)P(C l ) 
P(B)Et 1 P(A\C l )P(a) 
P{B)P{A) 


(.A and B are conditionally independent) 
(B is independent of all Ci s) 

(law of total probability). 


Problem 5 

In my town, it's rainy one third of the days. Given that it is rainy, there will be heavy traffic with probability , and given that it is not rainy, 
there will be heavy traffic with probability If it's rainy and there is heavy traffic, I arrive late for work with probability y. On the other 
hand, the probability of being late is reduced to - 3 - if it is not rainy and there is no heavy traffic. In other situations (rainy and no traffic, not 

o 

rainy and traffic) the probability of being late is 0.25. You pick a random day. 

a. What is the probability that it's not raining and there is heavy traffic and I am not late? 

b. What is the probability that I am late? 

c. Given that I arrived late at work, what is the probability that it rained that day? 

• Solution 

o Let R be the event that it's rainy, T be the event that there is heavy traffic, and L be the event that I am late for work. As it is seen 
from the problem statement, we are given conditional probabilities in a chain format. Thus, it is useful to draw a tree diagram. 
Figure 1.27 shows a tree diagram for this problem. In this figure, each leaf in the tree corresponds to a single outcome in the 
sample space. We can calculate the probabilities of each outcome in the sample space by multiplying the probabilities on the edges 
of the tree that lead to the corresponding outcome. 
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1 
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1 
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1 

8 



RTF P(R 
RTL C -s- P(/ 
RT C L -> P(. 
RT C L C -» P 
R C TL ->• P( 
R C TL C -f P 
R C T C L ->• F 
R C T C L C -> 1 


Fig. 1.27 - Tree diagram for Problem 5. 

a. The probability that it’s not raining and there is heavy traffic and I am not late can be found using the tree diagram which is 
in fact applying the chain rule: 


p(p c nrnL c ) = p(p c )p(t|p c )p(l c |p c nr) 

2 , ^ _ 3 
3 * 4*4 
= 1 _ 

8 ' 


b. The probability that I am late can be found from the tree. All we need to do is sum the probabilities of the outcomes that 
correspond to me being late. In fact, we are using the law of total probability here. 

P(L) = P(R, T, L) + P(R, T C ,L)+ P{R C ,T, L) + P{R C ,T C ,L) 

12 ' 24 ' 24 ' 16 

_ 11 
48 ' 
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c. We can find P(R\L) using P(R\L) = L^ry ~ ■ We have already found P{L) = IT, and we can find P(H H L) 
similarly by adding the probabilities of the outcomes that belong to R l~l L. In particular, 


P{RrL) 


P(R,T,L)+P(R,T C ,L) 

12 ' 24 
8 ' 


Thus, we obtain 


P(R\L) = 


P(RnL) 

P(L) 

1 48 

8 ' 11 
_ 6 _ 

11 ' 


Problem 6 

A box contains three coins: two regular coins and one fake two-headed coin (P(H) = 1), 

• You pick a coin at random and toss it. What is the probability that it lands heads up? 

• You pick a coin at random and toss it, and get heads. What is the probability that it is the two-headed coin? 

• Solution 

o This is another typical problem for which the law of total probability is useful. Let C\ be the event that you choose a regular coin, 
and let C 2 be the event that you choose the two-headed coin. Note that C\ and C 2 form a partition of the sample space. We 
already know that 


P(ff|Ci) = 0.5, 

P(H\C 2 ) = 1. 

a. Thus, we can use the law of total probability to write 

P(H) = P{H\C{)P{C{) + P(H\C 2 )P(C 2 ) 

= I 1 + i 1 

2 3 ' 3 

_ 2 

3 ' 

b. Now, for the second part of the problem, we are interested in P(C/2 | H ). We use Bayes' rule 


P(C 2 \H) = 


P(H\C 2 )P(C 2 ) 

P(H) 



2 _ 

3 

2 ‘ 


Problem 7 

Here is another variation of the family-with-two-children problem [1] [7]. A family has two children. We ask the father, "Do you have at least 
one daughter named Lilia?" He replies, "Yes!" What is the probability that both children are girls? In other words, we want to find the 
probability that both children are girls, given that the family has at least one daughter named Lilia. Here you can assume that if a child is a girl, 
her name will be Lilia with probability O: C 1 independently from other children's names. If the child is a boy, his name will not be Lilia. 
Compare your result with the second part of Example 1.18 . 

• Solution 
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o Here we have four possibilities, GG = (girl, girl), GB , BG , BB , and 

P(GG) = P(GB) = P(PG) = P(BB) = Let also P be the event that the family has at least one child named 
Lilia. We have 

P(L\BB) = 0, 

P{L\BG) = P{L\GB) = a, 

P(L\GG) = a(l — a) + (1 — a)a + a 2 = 2a a 2 . 

We can use Bayes' rule to find P(GG\L) : 


P(GG\L) 


P(L\GG)P(GG) 

P(L) 


P{L\GG)P(GG) 


P(L\GG)P(GG)+P{L\GB)P(GB)+P(L\BG)P{BG)+P{L\BB)P(BB) 


(2 a-a 2 ) 1 - 


(2a-a2)I +a I +a I +0 f 


Let's compare the result with part (b) of Example 1.18. Amazingly, we notice that the extra information about the name of the 
child increases the conditional probability of GG from to about y. How can we explain this intuitively? Here is one way to 
look at the problem. In part (b) of Example 1.18, we know that the family has at least one girl. Thus, the sample space reduces to 
three equally likely outcomes: GG, GP, BG, thus the conditional probability of GG is one third in this case. On the other 
hand, in this problem, the available information is that the event L has occurred. The conditional sample space here still is 
GG, GP, BG, but these events are not equally likely anymore. A family with two girls is more likely to name at least one of 
them Lilia than a family who has only one girl (P(P|PG) = P(P|GP) = CX, P(L\GG) = 2o — a: 2 ), thus in this case 
the conditional probability of GG is higher. We would like to mention here that these problems are confusing and counterintuitive 
to most people. So, do not be disappointed if they seem confusing to you. We seek several goals by including such problems. 

First, we would like to emphasize that we should not rely too much on our intuition when solving probability problems. Intuition is 
useful, but at the end, we must use laws of probability to solve problems. Second, after obtaining counterintuitive results, you are 
encouraged to think deeply about them to explain your confusion. This thinking process can be very helpful to improve our 
understanding of probability. Finally, I personally think these paradoxical-looking problems make probability more interesting. 


Problem 8 

If you are not yet confused, let's look at another family-with-two-children problem! I know that a family has two children. I see one of the 
children in the mall and notice that she is a girl. What is the probability that both children are girls? Again compare your result with the second 
part of Example 1.18 . Note: Let's agree on what precisely the problem statement means. Here is a more precise statement of the problem: "A 
family has two children. We choose one of them at random and find out that she is a girl. What is the probability that both children are girls?" 

• Solution 

o Here again, we have four possibilities, GG = (girl, girl), GB , BG , BB, and 

-P(GG) = P(GP) = P(PG) = P(PP) = Now, let G r be the event that a randomly chosen child is a girl. Then 
we have 

P(G r |GG) = 1, 

P(G r \GB) = P(G r \BG) = l. 


P(G r \BB) = 0. 


We can use Bayes' rule to find P(GG \ G r ): 


P(GG\G r ) 


P{G r \GG)P{GG) 

P{G7) 


P(G t \GG)P(GG) 

P(G t \GG)P{GG)+P(G t \GB)P(GB)+P(G t \BG)P(BG)+P(G t \BB)P{BB) 
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1 _ 1 _ 

2 4 " 


1-T + TT 

1 

2 ' 


So the answer again is different from the second part of Example 1.18. This is surprising to most people. The two problem 
statements look very similar but the answers are completely different. This is again similar to the previous problem (please read 
the explanation there). The conditional sample space here still is GG, GB , BG, but the point here is that these are not equally 
likely as in Example 1.18. The probability that a randomly chosen child from a family with two girls is a girl is one, while this 
probability for a family who has only one girl is y. Thus, intuitively, the conditional probability of the outcome GG in this case 
is higher than GB and BG, and thus this conditional probability must be larger than one third. 


Problem 9 


Okay, another family-with-two-children problem. Just kidding! This problem has nothing to do with the two previous problems. I toss a coin 
repeatedly. The coin is unfair and P(H) = p. The game ends the first time that two consecutive heads ( HH ) or two consecutive tails (TT) 
are observed. I win if HH is observed and lose if TT is observed. For example if the outcome is HTHTT , I lose. On the other hand, if 
the outcome is THTHTHH . I win. Find the probability that I win. 

• Solution 

o Let W be the event that I win. We can write down the set W by listing all the different sequences that result in my winning. It is 
cleaner if we divide W into two parts depending on the result of the first coin toss, 


W = {HH , HTHH , HTHTHH , • • •} U THH , THTHH , THTHTHH , • • •}. 


Let q = 1 — p. Then 

W = P{{HH , HTHH , HTHTHH , •• •}) + P{{THH , THTHH , THTHTHH , • • •}) 

= p 2 +p 3 q + p A q 2 H-h p 2 q + p 3 q 2 +p A q 3 H- 

= p 2 { 1 +pq+{pq) 2 + ( pq ) 3 H-) +p*q(l +pq + {pq) 2 + ( Pq ) 3 H-) 

= P 2 (1 + q) (1 +pq+ {pq) 2 + {pq) 3 H-) 

= v ^ 1 ^ , Using the geometric series formula 

_ P 2 (2-p) 

1 — P+P 2 


<— previous 
next —» 
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